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A NOTE ON CONVERGENCE TO STATIONARITY OF RANDOM 
PROCESSES WITH IMMIGRATION 

A. V. MARYNYCH 


Abstract. Let A’i,A’ 2 ,... be random elements of the Skorokhod space D(R) and 
• • • positive random variables such that the pairs (X 2 ,$ 2)5 • • • are in¬ 

dependent and identically distributed. The random process y{t) := 52fc>oXfc_|_i(t — 
. —^k) t € R, is called random process with immigration at the 

epochs of a renewal process. Assuming that the distribution of is nonlattice and 
has finite mean while the process Xi decays sufficiently fast, we prove weak conver¬ 
gence of (Y{u+t))u^R as t —>• oo on D(R) endowed with the Ji-topology. The present 
paper continues the line of research initiated in [3 [3]. Unlike the corresponding result 
in [3 arbitrary dependence between Xi and is allowed. 


1. Introduction 

Denote by D{M.) the Skorokhod space of right-continuous real-valued functions which 
are defined on K. and have finite limits from the left at each point of M. Let (D, P) 
be a probability space and let (X,^) be a random element in (D, P) with values in 
D{R) X [0, oo). More precisely, X := (A(t))tgR is a random process with paths in D(R) 
which satisfies X{t) — 0 for all t < 0, and ^ is a positive random variable. X and 
^ are allowed to be arbitrarily dependent. Further, on P) define the sequence 

(Ai,^i), (A 2 ,^ 2 ), ■. ■ of i.i.d. copies of the pair (V, ^). Let (5'„)„gNo (we use the notation 
No for the set of nonnegative integers {0,1 , 2 ,.. .}) be the zero-delayed random walk with 
increments ^k, i-C., 

So := 0, 5'n := -b ... -I- ^n, n G N. 

Denote by (u(t))tgR the associated first-passage time process given by iy{t) := inf{fc G 
No : Sk > t} for t G R. The process Y := (F(t))tgR defined by 

(1) Y{t):=Y,Xk+iit-Sk)= Xk+i{t-Sk), tGM 

fe >0 fc =0 

is called random process with immigration at the epochs of a renewal process or just ran¬ 
dom process with immigration. These processes were introduced in [ 313 ]. Since the paper 
at hand is intended to be a part of this series, we refrain from giving a detailed discus¬ 
sion here and refer the reader to the introduction in |3 for the motivation, bibliographic 
comments as well as the explanation of the term “processes with immigration”. 

In this note we are interested in weak convergence of random processes with immi¬ 
gration in the situation when E[|A(<)|] is finite and, in some sense to be specified later, 
integrable on [0, oo) and < oo. Under these assumptions and the additional as¬ 
sumption that X and ^ are independent, a functional limit theorem has been obtained 
recently in [3]. In the present paper we prove a counterpart of that result discarding the 
independence assumption. 

Before we formulate our main result, some preliminary work has to be done. In 
Sections II.II and [1.21 we recall some necessary information regarding the Skorokhod space 


2000 Mathematics Subject Classification. Primary 60F05; Secondary 60K05. 

Key words and phrases, random point process, renewal shot noise process, stationary renewal process, 
weak convergence in the Skorokhod space. 

The work of the author was supported by the Alexander von Humboldt Foundation. 


1 



2 


A. V. MARYNYCH 


D{M.) and the space of marked point processes. In Section fTTSl we present the construction 
of the stationary marked renewal process. 

1.1. Convergence in 0 Consider the subset Dq of the Skorokhod space I1(R.) 

composed of those functions / € I1(R) which have finite limits /(— oo) := limt_s._oo f{t) 
and /(oo) := limj^+oo/(t). For a,b G R, a < b let be the Skorokhod metric on 
D[a, b], i.e., 

= inf ( sup |a:(A(t))- 2 /(t)| Vsup 
AeAa.b VtG[a,b] s^t 

where = {A : A is a strictly increasing and continuous function on [a, b] with A(a) = 
a, A (6) = b}. Following [5J Section 3], for f,g G Dq, put 

do{f,g) ■■= ^0 ^(^(/), 0 ( 5 )), 

where 

(()(<):= log(</(l - t)), te(0,1), (()(0) =-oo, (/)(1) :=+00 

and 

(j) : Do ^ D[0,1], := x G Dq. 

Then {Dq, do) is a complete separable metric space. Mimicking the argument given in 0 
Section 4] and using do as a basis one can construct a metric d (its explicit form is of no 
importance here) on D{M.) such that {D(R), d) is a complete separable metric space. We 
shall need the following characterization of the convergence on {D{'R.),d), see Theorem 
1(b) in [5] and Theorem 12.9.3(ii) in [12] for the convergence on iA[0, oo). 

Proposition 1.1. Suppose fmf G D(M.), n S N. The following conditions are equiva¬ 
lent: 

(i) /n / m {D(U.),d) as n ^ oo; 

(ii) there exist A„ G A, where 

A := {A : A is a strictly increasing and continuous function on M with A(±oo) = ±oo}, 
such that, for any finite a and b, a < b, 

lim max-^ sup |/„(A„(u)) -/(u)|, sup |A„(u) - u| 1 = 0; 

n->oo 6] ue[a,b] ^ 

(iii) for any finite a and b, a < b which are continuity points of f it holds that 
fn\[a,b] f\[a,b] ^ (H[c, 6], dp’ ) as n ^ OO, whcrc <?|[a,h] denotes the restriction 
of g G iA(R) to [a, b]. 

1.2. Marked point processes and their convergence. In this section we recall the 
notion of a marked point process on R along with the corresponding canonical spaces. 
We refer to the books |6| and |9] for the comprehensive exposition of the theory of marked 
point processes. 

Let {K, pk) be an arbitrary complete separable metric space and let (R x K, p) be the 
product of R and K endowed with the product topology: 

p{{xi,ki),{x2,k2)) = \xi - X2\+PK[ki,k2), a;i,a;2GR, ki,k2GK. 

Let Mk be the set of integer-valued measures m on (R x AT, S(R x iL)) such that m(R x 
K) = oo and, for every bounded set A G S(R), 

m{A X K) < oo, 

where B(X) denotes the Borel sigma-algebra of the metric space X. An arbitrary m G Mk 
can be represented as a countable sum of Dirac point measures on R x AT: 

( 2 ) 

n^Z 


log( 


Kt) - Ks) 

t — S 


^This material was borrowed from and is given here for the ease of reference. 
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where the first coordinates can be arranged in the non-decreasing order: 

(3) ■■■ <t-2 <t-i <0 <to <ti . 

The elements of Mk are called marked point processes (“mpp” in what follows). A mpp m 
is called simple if the corresponding sequence is strictly increasing in which case 

representation m subject to constraints @ is unique. The sequence {tn)nGi. represents 
the arrival epochs and the sequence (fc„) represents the marks, so that kn is the mark 
brought by the arrival at time tn- The space K is called the mark space. 

It is known (see, for instance, [6l Chapter 1.15]) that Mk can be endowed with a 
structure of complete separable metric space, more precisely there exists a metric pmk 
such that: 

• {Mk, PMk) is a complete separable metric space; 

• ^ 0 as n ^ oo iff 

j /(a;)m„(dx) -A J f{x)m{dx), n ^ oo 

for every continuous function / : R x if —>• K+ with bounded support. 

The following proposition gives another characterization of the convergence on space 
{Mi~,Pmk) (see Theorem D.l and Corollary D.2 in [H] Appendix Dj). 

Proposition 1.2. A sequence mn '■= ^ S N, of simple mpp’s with the 

increasing enumeration of arrival epochs 

• • • < < 0 < 4”^ < 4”^ < 4”^ < • • • > ^ € N 

converges in {Mk, PMk) a simple mpp m := satisfying ([3]) iff 

{{t^-l,k^-l), ... , (4”\ ^44) ^ ((i-'D *-<?)> ■ • ■ > ^p))> n^QO 

for every p, g S N. 


1.3. Stationary marked renewal point processes and stationary random pro¬ 
cesses with immigration. Suppose that /r := < oo and that the distribution of f is 

nonlattice, i.e., it is not concentrated on any lattice dZ, d > 0. On the probability space 
(O, P), where the sequence {fk,Xk)kGN lives, define the following objects: 

• an independent copy {X_k,^-k)ken of {Xk,^k)keN; 

• a pair (Ag, ^g) which is independent of {Xk,^k)kei.\{o} and has joint distribution 


(4) < x,Xo e ■} = - [ j/P{5 e dy, A e •}, X > 0; 

M J[0,x] 


Set 

and 


• a random variable U, independent of {Xk,f,k)ke'z, with the uniform distribution 
on [0,1]. 


:=-(C-i + ... + C-fc), fceN 


S*o:=Ufo, Sl,-.= -{l-U)fo, S*k := S*o + Sk, := SI, + S-k, keN. 

The (unmarked) point process 

nGZ 

is called stationary renewal point process. Its properties are well understood. In partic¬ 
ular, it is shift invariant, i.e., same distribution as 

t G R. Its intensity measure is 

(5) ES{A) = p-^\A\, Ae,B(R), 
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where |A| is the Lebesgue measure of A. Now consider the process Xk as a mark brought 
by the point that arrived at time S^, so that the mark space K is D(R). It is natural to 
call the mpp 

( 6 ) 5 A 4 

n^Z 


two-sided stationary marked renewal process. Note that it is simple with probability one 
in view of the assumption P{^ > 0} = 1. The process is stationary (see Example 1 
on pp. 27-29 in [9] for the one-sided case) in the following sense: 

S^{{A + t} xB)= S-^iA X B), 


for arbitrary A £ 6(M), B £ B{D{R)) and t £R, where {A -1- t} := 
= denotes equality of distributions. Equivalently, 


(7) 


fcgz fcgz 


{a-\-t:a£A} and 


This fact is a simple consequence of Lemma 13.11 below (see Remark El]). It can also be 
deduced from the Palm theory of stationary point processes, see e.g. Chapter 4.8 in [lOj . 

Erom the construction above it is clear that the distribution of the stationary renewal 
point process is symmetric around the origin: 


( 8 ) 


n^Z n^Z 


Eor every k £2, the mark Xk depends only on the interarrival time = S^ — Sl_i. This 
observation together with (|8|) allows us to conclude that 

(9) X! ^(.SkXn) = 

n^Z n^Z 


Fix any u G R. Since limfe^_oo S'^ = —00 a.s. (almost surely), the sum 
(10) ^ Xfe(u + 5:)l{s*>-„} 

k<-l 

is a.s. finite because the number of non-zero summands is a.s. finite. Define 

Y*{u) := Y.Xk{u + SI) = ^ Xu{u + SI) l{s.>-„} 
fcez feGZ 

with the random variable Y*(u) being a.s. finite provided that the series J2k>o ^k{u Y 
S^) l{s^>_u} converges in probability. The process Y* := (E*(it))ugR is called stationary 
random process with immigration. In view of © the process Y* is strictly stationary in 
the usual sense. 

Note that from © we obtain 

Y*{-) ^ Y. ^'^+i (-+= E Msi>-u} ■ 

feGZ fcGZ 

In [3] the stationary process with immigration has been defined by the series on the right- 
hand side of the last equality. In some situations this representation is more convenient. 
For example, it shows that Y*{u) = F*(0) = X]fc>o particular, ([SJ readily 

implies 

poo 

EY*{u)=EY*{0)= EX{t)dt, 

Jo 

since Xk+i is independent of S^ for fc > C0. 


^However, for k < 0 the mark depends on S^. 
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1.4. Main result. In the following we write ^Zt ^ Z as t ^ oo on {S,d*y to denote 

weak convergence of processes on a complete separable metric space {S,d*) and ‘A’ to 
denote convergence in distribution of random variables or random vectors. 

Let 21 be the support of the discrete component of i.e., 21 := {t > 0 : P{^ = 0 > 0}; 
and set 

< 21 >:= I ^2 : flz S 21, rii e Noj. 

i 

Observe that a € < 21 > iff hits a with positive probability. Further, let 

( 11 ) 

P := {t e M : P{X(t) 7^ X{t-)} > 0}, V^:={tGR: P{X(^ + t)^ X(^ +1-)} > 0} 
and 

(12) Xx •— © d) '.= {a — b a ^ ^ ^ 1^}* 

Theorem 1.1. Suppose that /i := < oo and the distribution of is nonlattice. 

(a) If the function G(t) := E[|X(<)| A 1] is directly Riemann integrabl^ (dRi) on 

[0, oo), then, for each u G R, the series X)/c>o + S^) is absolutely 

convergent with probability one, and, for any n G N and any finite Ui < U 2 < 

... <Un such that Y* is almost surely continuous at Ui, 

(13) {Y(t + ui),...,Y{t + Un)) A (y*(Mi),... ,y*(M„)), t^oo. 

(b) If, for some e > 0, the function Hg(t) := E[sup„g[(_(_|_g] |f'f(u)| A 1] is dRi on 
[0,oo), and 

(14) < 21 > n Ax = 0, 
then 

(15) Y{tYu) ^ Y*{u), t ^ oo on (I1(R), d). 

Remark 1.1. Condition (HI needs to be checked only if the distribution of f has a discrete 
component. Otherwise, it holds automatically. If ^ and X are independent, condition 
(1141) can replaced by the following simpler condition 

(16) < 21 > n = {0}, 

where Ax :=T> QT>. It can be verified that (ITSl) is equivalent to formula (2.3) in [3]. 

2. Examples and applications 

In this section we give a few examples from several areas of applied probability in 
which the random processes with immigration appear. Further examples can be found 
in Section 4 of [3]. 

2.1. GI/G/oo queues. Let (^, 77 ) be a random vector with positive components and let 
((Cfcidfc))feeN be a sequence of independent copies of (C,d)- Assuming that ^ and rj are 
independent and interpreting as the interarrival time between fc-th and {k + l)-st 
customer and rjk as the service time of the A:-th customer in the queuing system with 
infinitely many servers, we obtain the classical GZ/G/oo queue. However, in real world 
situation the assumption that and rjk are independent is not always adequate and one 
may consider, for example, the model with positively correlated and pk, i.e., the larger 
service time of the last arrived customer, the more time it takes for the next customer 
to arrive. One of several quantities of interest is the number Y(t) of busy servers at the 
system at time t 

^ ^ ^{‘Sfc<t<Sfc+T/fc + i} 

fc >0 


^See Chapter 3.10.1 in [8] for the definition of direct Riemann integrability. 
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which is a particular instance of the random process with immigration with X{t) := 
l{r/>t>o}- Assuming that the distribution of ^ is nonlattice, has finite mean and condition 
(fT4)) is fulfilled we can apply our Theorem ll.il to deduce that (fT^ holds iff E 77 < oo. If the 
latter holds the queuing system possesses a stationary regime. In the case of independent 
^ and rj a one-dimensional version of this result has initially been proved in [4] . 

2.2. Divergent perpetuities. Let (^, rj) be a random vector with P{^ > 0} = 1 and 

put X{t) := t > 0, where a > 0 is a fixed constant. Then, for every fixed t > 0, 

Y(t) is the normalized truncated perpetuity given by 

v(t)-l k 

y(t) = e““‘ ^ ? 7 fe+ie“'^'= = ^ 77 fc+i]^e“^S t > 0 . 

k—0 k—0 i—1 

Assuming that < 00 and that the distribution of ^ is non-lattice we infer that dTSl) 
holds if E(log''' \r]\) < 00 . Indeed, since V = {0} and = —21 we conclude that 
Ax = —21 which implies that (11^1) holds. Further, for every e > 0, the function 

H,{t)=E[ sup |A(u)| Al] =E[| 77 |e"“*Al], <>0 

is non-increasing, hence dRi iff it is Lebesgue integrable iff E(log~'" |? 7 |) < 00 . Whenever 
the latter holds the one-dimensional distribution of the limiting process can be charac¬ 
terized via the distribution of a suitable convergent perpetuity. By stationarity of Y* we 
have, for u > 0 , 

Y*{u) = y*(0) = ^ 77 fce-“®^ = 7 ?oe-“^«* -f ^ 77 ^, 6 "“^'= =: 77 oe-“^« -F Aoo- 

fc >0 fc>l 

Here ( 770 , S^) is independent of a perpetuity which satisfies the distributional eqnality 

Aoo=r?e-“«+e-<A'^, 

where A'^ = A^o and A'^ is independent of (^, 77 ). 

2.3. Continuous time random walks. A continuous time random walk (ctrw, in 
short) (C(t))tgR is defined by 

C{t) = ^ Jk+i, 

k=0 

where (zz(t))tgR is as before and {Jk)k€n is a sequence of random displacements which 
is usually assumed to be comprised of i.i.d. random variables. C(t) is then interpreted 
as the position at time t of a particle performing jumps of sizes Jk+i at the epochs Sk, 
k = 0 ,..., 1 /( 1 ) — 1 . If Jfc and ^k are independent for every fc G N the ctrw is called 
uncoupled, otherwise it is coupled. For the up-to-date exposition of the limit theory for 
ctrw we refer to [7] and references therein. 

If X in the definition of the random process with immigration takes the form X (t) = 77 , 
t > 0, for some random variable 77 , then Y is the classical ctrw. In general, the 
random process with immigration can be thought of as a generalized ctrw with time- 
inhomogeneous jumps in which the displacement size depends on the time. The situation 
considered in our Theorem o covers a very special class of such “generalized coupled 
continuous time random walks” with finite mean of the waiting times and rapidly de¬ 
creasing displacement process X. 

3. Proof of Theorem 11.11 

Our proof relies on the sequence of auxiliary lemmas given next along with the contin¬ 
uous mapping arguments. In what follows we write M as a shorthand for and pM 

for the corresponding metric so that pm) is a complete separable metric space 

(see Section [12] above). 
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Lemma 3.1. Assume that < c» and that the distribution of ^ is nonlattice. Then, 
as t ^ oo, 

(1’^) 

k& feGZ 

on {M,pm). 

In view of Lemma 5.1 in [3], the result stated in Lemma ld.ll is quite expected. However, 
the rigorous proof is technically involved. Hence it is relegated to the Appendix. 

Remark 3.1. Fix u € K. The shift-mapping 9u ■ M ^ M defined by 9u{m(A x B)) = 
m({A -I- u} X B), A G B G A1(I?(M)) is obviously continuous with respect to pM 

for every u G K.. Therefore, as t ^ oo, 

fcez feez feez 

feez feez 

on (M, Pm) which shows that S-^ is stationary. 

Lemma 3.2. The mapping T : M. x il(K.) — D(R) defined by 

T{h,f{-))=f{h + -) 

is measurable with respect to i3(K.xil(IR)) and S(R) and continuous ouRxil(R) endowed 
with the product topology. 

Proof. To show the measurability note that by Lemma 2.7 in m it is enough to show 
that (to)/(•)) /(to + t) is measurable for every t G K, but this is obvious since this 
mapping is a composition of two measurable mappings (to,t) i—5> to -I- t and / !-->• /(t). 
The continuity has been proved in [3], see Lemma 5.2 therein. □ 

For fixed c > 0, t G N and (ui,... ,ut) G K/ define the mapping (fc^ : M —>■ R* by 

^ ^ /«(•))) ^ fn{tn + Uj) l{|i„|<c} ^ 

riGZ ^riGZ /j=l,...,l 

and the mapping (fc ■ M ^ D{M.) by 

'^'=( ^ ^(in,/„(•))) ■“ ^2 + ■) ^{|tn|<c} • 

n^Z nGZ 

For / G 7t(R), denote by Disc(/) the set of discontinuity points of / on R. Clearly, both 
cfc'^ and (fc are measurable as finite sums of measurable mappings. The continuity is 
provided by the next lemma. 

Lemma 3.3. The mapping is continuous at all points m = Znez'^(tn./nl-)) 
that m is simple, m({—c, c} x D{M.)) = 0 and for which ui,... ,ui are continuity points 
of fk{tk + •) for all k € li. (jic is continuous at all points m = Znez'^(tn,/n(-)) that 
m is simple, m{{—c, c} x D(M.)) = 0 and Disc(/fc(tfe -I- •)) nDisc(/j(tj + ■)) = 0 for k ^ j. 

Proof. Let c > 0 and suppose that 

(18) ^ n^oo 

lez " ’ " iez 

on (M, Pm) where m({—c, c} x DfR.)) = 0. Let p, g G No be such that 

(19) t_p_l <7 C ^ t—p, tq <C. C ^ tg_|_x. 

From (IT31) . using Proposition [121 we conclude that for —p < fc < g 

(20) (4"^/fc"^)(^fe>/fc)> n^oo 
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on R X D{R.) and also for large enough n 
(21) 

By Lemma [XU convergence (pH)) yields 

(22) \^k ^ + ■) “^ fk{tk + Oj n —>■ oo 

on D(]R). 

Now assume that ui,... ,ui are continuity points of fk{tk + •) for all fc G Z, then (l22l) 
implies that 

(/fe”^(4 ”^+“«)) ^ {fk{tk + ui),...,fk{tk + ui)), n^oo 

for —p < k < q. Summation of these relations over k = —p, ■ ■ ■ ,q proves the continuity 
of (/)c in view of (IT^ and ((2T]) . 

Theorem 4.1 in m tells us that addition on D{M.) x D{M.) is continuous at those (a;, y) 
for which Disc(a;) nDisc(?/) = 0. Since this immediately extends to any finite number of 
summands we conclude that relations (ED) entail 

Q q 

4>c{mn) = ^ /fc”^(4"^ + ‘) ^ X! fk{tk + ■) = 4>cim), n^oo 

k——p k——p 

on D{M.) provided that Disc(/fc(tfe + •)) fl Disc{fj(tj + •)) = 0 for k ^ j. □ 


Remark 3.2. The assumption that m is simple could have been omitted at the expense 
of a more involved proof. The present version of Lemma 13.31 serves our needs. 


The next lemma relates the integrability of X to pathwise properties of Y*, the sta¬ 
tionary process with immigration. 


Lemma 3.4. Assume thatlK^ < oo and that the law of ^ is nonlattice. 

(i) If G{t) = E[|J'f(t)| A 1] is Lehesgue integrable on [0,oo), then |y*(u)| < oo for 
every it G R almost surely. 

(ii) If, for some (hence all) £ > 0, the function IIg(t) = E[sup„g[(_(_|_£] |y(u)| A 1] is 
dRi on [0, oo), then Y*{u) takes values in D(R) almost surely. 

Proof of (i). Put G{t) := E[|X(^ -|-1)| A 1] and note that 

pCC) poo p^ 

/ E[\X{(,+t)\Al]dt = E [|y(t)| Al]dt-E / [|X(t)| Al]dL 

Jo Jo Jo 

Since E [|X(t)| Al]df < E^ < oo we see that the Lebesgue integrability of G is equivalent 
to the Lebesgue integrability of G. Fix u G R and set Zk := Xk{u + Sl,) fc G N. 

We have 


^E[|Zfc|Al] 

fceN 


+ 

< 


^ E[i\Xki^k +U + SU)\ A 1) l{s.>-„}] 

fcGN 

E[(|Xfe(a +U + SU)\ A 1) 

ken 

E[(i-^fe(Cfe+u -f s'fc_i)i A1) i{s*>-M>s*_j}] 


ken 


^E[G(u + St_,)] >-u> S:_,} 


ken 


1 r 
M Jo 


Gis)ds + E{-u > 5o*} 
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having utilized JS]) for the last equality and independence of Xk and for fc € N. 

Therefore the following two series 

J2n\Zk\>l} and 
feeN feeN 

converge. The convergence of the first series together with the Borel-Cantelli lemma 
implies that > 1 for only finitely many k a.s., while the convergence of the second 
implies that \^k\ l{| 2 fc|<i} < oo a.s. Hence \Zk\ < oo a.s. and |T*(m)| < oo 

a.s. since X]fe<o contains only finitely many summands for every fixed it € R. 

Proof of (a). Again we start with the proof that dRi of is equivalent to dRi of 
Hgit) := E[sup„g[( (_|_g] |Ai(^ + it)| A 1]. Note that A(^ + •) with probability one takes 
values in D(R), hence, using exactly the same arguments as in the second paragraph of 
Section 3 in [3], we conclude that dRi of is equivalent to 


(23) 

^E 

sup 

(|A(C + t)|Al) 

< oo. 


fc>0 

- t^[k,k-\-l] 



We have0 





sup (|A(^ + t)|Al) 

II 

sup (|A(t)|Al) 

fc>0 


fc>0 

^tG[C+fc,?+fe+l] 



< ^E 

sup (|A(t)|Al) 

= E ^ [ sup (|A(t)| A 1) 

fc>0 


fc>[{j ‘e[fc,fc+2] 


Ul-i 

= E^ [ sup (|A(t)|Al) -E ^ [ sup (|A(f)|Al) 

t^[k^k-\-2] k—0 t^[k,k~\-2] 


Since E^^'^q ^ sup^gj^, ,j^ 2 ](l-^(^)l 1) ^ < E^ < oo we conclude that (|23l) is 

equivalent to 


E 


^ L +/-r^ ^_Lol 


t^[k,k-\-2] 


< OO 


which, in its turn, is equivalent to dRi of Hg (see formulae (3.2) and (3.3) in [3]). Hence 
(l23)l holds. 

In order to show that Y* takes values in D{M.) with probability one, we use the fact 
that locally uniform limits of elements from D{M.) are again in D{M.). Therefore it is 
enough to check that the series Y*{u) = X^fcez ^k{u + S'^) converges uniformly on every 
compact interval a.s. which is a consequence of the a.s. convergence of the series 


(24) 


sup \Xk{u + Sl)\ 

feGZ 


for any fixed a < b. Arguing in the same vein as in the proof of part (i) above, we see 
that it suffices to show 


E^ sup (|Afc(Cfe + u + S'fc_i)| A 1) < 00 , 


'^We use the notation [icj := sup{/c € Z : /c < x}, x € M. 
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In view of the independence of Xk and Sl_^ for fc e N, we observe that 
E ^ sup (|Xfc(efc+u + 5^_i)|Al) 

^gpjUG[a.6] 


= E 

E® 

sup {\X{i + u + S:_,)\Al) 




. u^[a,b] 

J. 

< E 

Ee 

sup (|X(^-bM-b5fe_i)| Al) 

^k-1 


- feGZ 


J J 


= - f E 


M Jr L u^[a,b] 

< — ^ sup E 
M fegzte[fc.fc+i) 


sup (|X(^ + u + t)| A 1) 


dt 


sup |X(^ + m)| A 1 


(25) 


< const E 


fegz L“G[fe,fe+l) 


sup |X(^ + m)| A 1 


where the last equality is a consequence of m and the last inequality follows from (5.9) 
in [3]. The last series converges in view of (l23ll . It remains to note that 

E^ sup (|Xfe(^fc+M + S'fe_i)| Al) < E P{b + s;> 0 }<oo. 

Thus J2kei,^k{u + S'^) converges uniformly on [a,b] for all a < 6 a.s. and therefore is 


-valued a.s. 


□ 


Lemma 3.5. If (|14l) holds, then 

P{Disc(X,(S'* + •)) n Disc{Xj{S* + ■)) 0} = 0, a j S Z, i> j. 

Proof. Define the following random sets 

Df := Disc(X,(ei + •)), := Disc(X,(-)), := of © i,j€Z 

and observe that for every t G M the events {t G {t G and {t G ^^0 

measurable. Put 

Vf := {t G K : P{t G of} > 0}, V^^'> := {t G R : P{t G > 0}, 

ph.j) := {t G R : P{t G > 0}, i,j G Z. 


Note that by definition 

(26) P{t G of \ V,} = P{t G \ Vj} = P{t G \ = Q, i,j G Z, 

for every fixed t G R. We have for i > j 

P{Disc(W(S'* -b •)) n Bisc{Xj{S* + ■)) 7 ^ 0} 

= Pjthere exists u{uj) such that S* + u{uj) G Disc(Xi(-)), S* + u{uj) G Disc(Xj(-))} 

< ¥{S* - S* G Disc(X,(-)) 0 Disc(X,(-))} 

= -b . . . -b ^j+l G Disc(Xi(-)) 0 Disc(Xj('))} 

= + . . . + f,j+l G Disc(W(^i -b •) © Disc(Xj(-))} 

= PU,-i + ... + C7+i 

< P{C,_1 + ... + G + P{e.-1 + ... + ^j+1 G \ 

Since ■fj+i) ■ • ■) Ci-i are independent of the second term vanishes in view of (051) . 
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Pick an arbitrary to G . By definition we have 

0 < P{to e Disc(Xj(^i + ■)) © Disc(Xj(-))} 

< +]P{io G (Disc(X,(e, + ■)) \ X)«) 0 (Disc(X,(-)) \ 

+ P{to G Disc(X,(e» + ■)) e (Disc(Xj(-))\v(^^)} 

+ P{to G (Disc(X,(C, + •)) \ © Disc(X,(•))}. 

The last three probabilities equal zero in view of the first two equalities in (l26)l . the 
independence of Xi(^i + ■) and Xj(-) and the fact that both and are at most 
countable a.s. Hence 0 < which implies tg G and thereupon 

^ pW QX)0'). 

Thus, we have proved that 

P{e.-i + ... + G+i G < P{^,_i + ... + G Vf © 

If i,j ^ 0, then and = V (see (ITTl) for the definition of and V), and 

the probability on the right-hand side of the last centered inequality equals P{^i-i -b 
... -b G Ax}- The cases z = 0 or j = 0 require a separate treatment since the joint 
distribution of (Ao,^o) is other than that of (X,^). We only treat the situation when 
i = 0 and show that C the other case being similar. Assume that tg ^ and 

consider the set Atg := {/(•) G D{M.) : /(to) 7^ /(^o—)}■ Using (|4]) we have 

pOO 

^{^o(^0 + *) ^ ^ © {y}? Co ^ dy} 

i - / 2/P{CGdy,X(-) G ©Ml 
M Jo 

= - r ymGdy,Xi^ + -)GAt,}. 

M Jo 

The probability under the integral sign equals zero identically in view of tg ^ • Hence 

P{Xo(^o + ■) G Atol = 0 which is equivalent to tg ^ This shows that C V^. 

In the same vein, we infer C V and therefore 

]P{Ci-i + • ■ • + 0+1 G ^ © < P{0-i -b • ■ • + 0+1 G © V} 

provided that z = 0 or j = 0. Combining pieces together we obtain 

P{Disc(Xi(S'* -b •)) n Disc(Aj(S'* -b ■)) 7^ A P{0-i + ■ • ■ + 0+i G Ax}- 

If j > 0 or z < 0, then 0-i + - - - + 0+i = whence P{0-i + - ■ - + 0+1 G Ax} = 0 

by (fid)) . If j < 0 < z the latter equality also holds since the support of the discrete 
component of 0 is the same as that of f by (|1]). The proof of Lemma [33] is complete. □ 

With these preparatory results at hand we are ready to prove Theorem ll.il 

Proof of (fTK]) . We shall use Lemma 13.31 To this end, observe that each S* has an 
absolutely continuous distribution. In particular, S'^ is simple mpp and S'^{{—c,c} x 
D(K.)) = 0 a.s. for every c > 0. From Lemma [3.31 and Lemma [3.51 we see that (pc is a.s. 
continuous at Efeez^(S^,Xfc) and therefore ([iTl) implies 

Uc(L-) := y^Afc+i(f- 5'fc -b •) l{|t-5fc|<c} = </>c( y^^p-Sfc.TCfc+i)) 

feez feez 

fcez fcez 


( 27 ) 
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on d). 

Using Proposition II.11 we conclude that in order to prove (fTSl) it suffices to check that 


(28) 


Y{t + u) => Y*{u), t —!> oo 


on {D[a, b], d^’^) for any a and b, a < b which are not fixed discontinuities of Y*. To this 
end, first observe that (EZD implies 

(29) Yc{t,-) => U;(-), t^oo 

on {D[a, &], dg’ ) for any a and b, a < b which are not fixed discontinuities of Y*. 

From the proof of Lemma 15^ we know that the series which defines Y*{u) converges 
locally uniformly in m S R. Hence for every fixed tg G K we have 

P{to G Disc(F*(-))} = Pjthere exists k gZ such that tg G T)isc{Xk{S^ + ■))} 

= ^P{toGDisc(Xfe(5,* + -))} 
feez 

feez 

(30) = P{to G Disc(y,*(-))} 

where the second and the last equalities follow from Lemma [3.51 The process U*(-) is 
stationary and is a.s. _D(]R)-valued by Lemma [3.4r iil. Hence P{to G Disc(y),*(-))} = 
P{to G Disc(F*(-))} = 0 which implies that (1^ holds for all a < b. 

Now (|28)) follows from Theorem 4.2 in [1] if we can prove that 

(31) y;* ^ Y*, c-^oo 
on (H[a, 6], dg’^) and that 


(32) 


lim limsupP-j dg’ {Yc{t, ■),Y{t + ■)) > e ^ =0 


c->oo t^oo 




for all e > 0 and any a, 5 G K, a < 6. Since dg’** is dominated by the uniform metric on 
[a,b], relation ([M)l follows from 


lim lim sup P< sup 

c-^-oo t_^oo l«G[a,h] 


^Xk+liu + t - Sk)l{\ t-Sk\>c} 
k>0 

+ ^^“ 5 'fc)i{|t-Sfci<c} 

k<0 ^ 


= 0 


for all 

e > 0 and any a, 6 G R, a ■ 

(33) 

lim lim sup P< 

sup 


c—>oo 4_).oo 

L uG[a, b] 

and 



(34) 

lim lim sup P< 

sup 


i—>-oo 1 

^ ue[a, 6] 

The proof of (1551). given on p. 1' 


Xk+i{u + t- Sk) l||t-5fc|>c> >ei=0 
fe >0 ^ 

y]]-^fc+i(u + i — 5'fc) l{|t_Sfc|<c} > e > = 0. 


are independent for A: > 0. The relation (j34|) is trivial since 
(35) Xk+l{u + t- Sk) = 0 


k<0 


for t > c > 0. 

As for relation ([M]) we claim an even stronger statement 
(36) sup |i;*(u)-y*(u)|-^0, 

ue [a,&] 


CX) 
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a.s. for all fixed a, b. Indeed, 

sup 117(11) -y*(M)| < ^ sup |Xfe(u + S'^)| 1 {|S.|>C} 

uG[a,b] 

Invoking the monotone convergence theorem we deduce that the right-hand side tends 
to zero as c —>■ 00 in view of (IMl) . 

Proof of (ITS)) . Fix I S N and real numbers and ui,...,ui. According to 

Lemma [3.31 for every c > 0, the mapping is continuous at iXk+i)kez) 

a.s. Now apply the continuous mapping theorem to (EH) twice (first using the map (fc'^ 
and then the map (xi,... ,xi) 1 —aiXi aiXi) to obtain 

i i 

^^aiYc{t,Ui) '^aiY*{ui), t ^ oo. 

The proof of (fT51) is complete if we verify 


(37) 


I I 

'^aiY*{ui) A '^aiY*{ui), c^oo 
2=1 2=1 


and 


f ^ 

lim limsupP<^ ^ (ai'^Xk+i{ui + t- Sk) l{|t-Sfe|>c} 
1^00 t^oo I -1 ^ 

^ 2=1 fe>0 


(38) 


+ ^ Xk+i{ui + t — Sk) l{|t-Sfc|<c}) 
fe <0 



= 0 


for all e > 0. As for dSzl), an even stronger statement holds: Yf{u) —>■ Y*{u) as c — >■ cxd 
a.s. for all u S R. This can be checked in the same way as (1361) using the fact (see Lemma 
13.4^ 11 that 


E 


^|Afe(u + ,S*)|Al 


Further, 


fcgZ 

is a consequence of 


< 00 . 


lim limsupP<^ ^Xfe+i(it + t- Sk) > £ > = 0 


which has been checked on p. 15 in [3] (the independence between X and ^ was not used 
in that proof), and equality (l3^ which holds for t > c > 0. The proof of Theorem II.II is 
complete. 


4. Appendix 

Proof of Lemma 13.II Observe that, for all t > 0, 

^ ' ^(t—Sk,Xk+i) ^ ^ 


kez 


Hence, according to Proposition ll.21 it is enough to prove that, for all p, g G N, as t —>■ 00 , 
(39) 

(jf — Aj^(t)+p), ■ ■. ,{t — —> (j^Sfp, X-p ),..., (S*,Xq)^. 
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Let y, z,yi,..., ?/p_i, zi ,..., Zq be arbitrary nonnegative numbers and ... ,Aq arbi¬ 
trary sets in Define the events 

^i(^) {t ~ < z,t — >—y, G Aq}, 

^2{t) ■= {^l/(t) + l yii A^u{t) + l € 11 ■ • ■ I C!^(t)+p—1 ^ 2/p—1: ^i/(t)+p—1 p+l}i 

^3 (0 * —1— — l ^ ; ■ • ■ ; —g — ^qi ^l'{t)—q ^ -^g}; 

^ 4(0 •“ {-^i/(t)+p € ^-p}- 

Then (l39l) is equivalent to 

lim P{fi(t) n £’2(t) n £■3(2) n £4(2)} = >-y, < z,Xo e Ao} 

t—^00 

xP^^—i yi, JC—i ^ -A_i, . . . , yp_i, G A_p_|_i} 

^ ^1; ^1 G Al, . . . ,^q < Zq, JCq € Aq}W‘{X—p G A—p} 

= P{5* 1 > -y, s* <z,XoG Ao}P{X G A_p} 

p-l g 

X n ^ ^ e n ^ ^ ^ 

2=1 2=1 


The probability on the left-hand side can be replaced withp(t) := P{fi(t)n£' 2 (t)nf 3 (t)n 
S 4 {t),i'{t) > q}, for P{j/(t) < g} —>• 0 as t —5> 00 .Conditioning on iy{t) we obtain 

p(t) = ^ ¥{£ 1 ( 1 } n£ 2 (t) n£ 3 (t) n£ 4 (t),iy(t) = k} 

k>q+l 

= P{£i(i)n£:2(t)n£3(t)n£:4(t),Sk-i <t,Sk >t} 

k>q+l 

= P{£i(t) n£ 3 (t), Sk-i < t, Sk > t} 

k>q+l 

p-l 

xP{Xk+p G Gl_p} n PlCfe+z — Vi-! ^k-\-i ^ ^—i}’ 

2=1 

Thus, it remains to show that 

(40) lim 'Y] F{£i{t) r\ 83 {t),Sk-i <t,Sk > t} 

k>q-\-l 

Q 

= P{-^li < 2/, < z, Xo G Glo} n ^ € A J. 

2=1 

We continue as follows 


p{fi(t) n £3(t),Sk-i <t,Sk> t} 

= P{t - z < Sk -1 <t,t<Sk<t + y,XkGAo, 

^k — l £1 ■2^1; Xk—1 G Al^ • ■ • ; ^k—q ^ ^qi Xk—q G Ag^ 

= / P{t - z -V < ^k -1 + ■ ■ ■ + Cfc-g <t-V,t-V<^k + ---+ ik-q ^t + y -V, 

Xk G Aq ^ ^k — 1 ^ Xk — 1 ^ Al ^ ^ ^k—q ^ -2^g; Xk—q G Aq}P \^Sk—q—l G du} 

= / P{2 — z — z;<^i-|-...-|-^q<t — i;,2-i;<^i-|-...-|-^q-|-|<i-|-?/ — n, 

•/[o.t] 

^ G Aq, < Zl, Xl G Al, . . . ,^q < Zq, Xq G Aq]P{Sk-q-l G di;}, 

=: [ p{t - n)P{5'fc_q_i G di;} 

Jlo,t] 
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where 


p{u) := P{m — z < Sq < u,u < Sq + i < u + y,X G Aq, 


Cl — ^1 j ^1 £ ^11 ■ ■ ■ I C? — j G -^q } i 


and (X,^) has the same distribution as (X,^) and is independent of everything else. 

The nonnegative function p{u) is dRi because it is locally Riemann integrable and 
bounded from above by a nonincreasing integrable function u i—>■ P{5'q + C > i*}- By the 
key renewal theorem, we infer 

F{£i(t) n£ 3 {t),Sk-i <t,Sk > t} = y] / p(t - u)P{S'fc_,_i G du} 


k>q-\-l 


k>q-\-l 

i r 

M Jo 


[O.i] 

p{u)du 


as t ^ oo. Hence proving (HOI) amounts to checking the equality 

q 

(41) < y,S^ <z,XoG G A,} = 

i=l 


M Jo 


p{u)du. 


Set £ := {Cl < Zi,Xi G Hi,... ,Cg < Zq,Xq G H,} and rewrite p{u) as follows: 

p{u) = ¥{u-z < Sq < u - - y)+,z > {i - y)+,X G Ao,£} 

= VlSq + Z A ^ > u,z A^ > - y)+,X G Ao,£} 

- PIS', + (C - y)+ > u, z A C > (C - 2/)+, G Ho, £■}. 

Then 


Jo 


p{u)du — + z a C) l{zA 5 >(C-y)+,AeAo,£} 


{£q + (C y) + ) l{zAC>(J-y) + .AeAo,£} 
-E^z A C - (C - 2/)+)^ l{HeAo,£} 

iE(zAC-(C-2/)+)^l^^g^^jP{£:} 

-e(zac-(C-2/)+) i^j,^^^yY[r{^<z,,x g a,}, 




where we have used that £ is independent of (X,C). Applying formula (|4]) we arrive at 
n-Sh < y, <z,XoG Ho} = P{(1 - [/)Co < y, U^o <z,XoG Ho} 

= [ PjCo < 2/(1 - s)"\Co < Ao G Ho}ds 

Jo 


10 1 


y-Jo J [0, y{l — s)-^Azs~^] 
’.jthX 


tP{C G dt,A G Ho}ds 


_ 1 
/I 

and (1411) follows. The proof of Lemma [XT] is complete. 


)pKA*,A'£.4o) 

M J [0, oo) 

^E^zAC- (C-y)+) 


y- -'[O.oo) ^ J{l-y/t) + 

[z At - {t-y)jJ) PjCGdt.AGHo} 


{X^Aq} ’ 
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